Skip to content
This repository was archived by the owner on Feb 6, 2020. It is now read-only.

S3training #94

Open
wants to merge 13 commits into
base: development
Choose a base branch
from
Open

S3training #94

wants to merge 13 commits into from

Conversation

xiuliren
Copy link
Member

@xiuliren xiuliren commented May 13, 2016 •
edited
Loading

  • reorganized and renamed the python scripts.
  • support persistent training using aws spot instance without starcluster and EBS volume. still need some more tests. The idea is to use S3 as persistent storage. Download all the required files from S3 to local instance and upload the trained network to S3. In the web console, there is a type of persistent spot instance which can keep spot instance going. What we need is setting the UserData appropriately. This will facilitate training a lot.

@xiuliren xiuliren mentioned this pull request May 13, 2016
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@xiuliren